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(54) Image processing apparatus and methods, and tranfer media 



(57) An image on the original to be printed on a print 
sheet (P in ) by a printing machine (13) is scanned by a 
scanner (20), and the data is edited by an editing section 
(10). The edited data is converted from the data depend- 
ent on the device (printing machine) to data not depend- 
ent on the device with the use of a device profile (P.,) 
included in a converter (11). A luminous-environment 
conversion circuit (1 2) compensates the data sent from 
the converter (11) according to the data corresponding 



to surrounding light, output from a sensor (S 1 ), and data 
related to the paper color of the print sheet (P in ), output 
from a sensor (S 2 ). Another luminous-environment con- 
version circuit (15) compensates input data according 
to the paper color of a print sheet (P out ) in a printer (30) 
or surrounding-light data, output from sensors (S 3 and 
S 4 ). Another converter (16) converts the output of the 
luminous-environment conversion circuit (15) to data 
dependent on the printer (30) and the data is printed on 
the print sheet (P out ) by the printer (30). 
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Description 

[0001] The present invention relates to image processing apparatus and methods, and to transfer media. 

[0002] Fig, 13 of the accompanying drawings shows a processing flow in conventional printing. As shown in the 

s figure, the original to be printed by a printer is prepared. This original is read by a scanner, a digital camera, or others, 
and edited by an editing apparatus such as a personal computer. The edited image data is printed on a sheet by a 
printer which is simpler than a printing machine used for final printing and output as a comp output. The editor checks 
the layout of characters and a picture by this comp output. When the desired layout is achieved, the image is output 
on a film. Then, a proof lithographic plate is created from the film and the image is printed on a sheet by a flatbed proof 

10 machine with the use of the proof lithographic plate. Color-matching check is performed by the image printed on the 
sheet by the flatbed proof machine. If the desired color is not obtained, the processing flow returns to editing. Comp 
output, film output, printing with a proof lithographic plate, and color-matching check are again performed for the edited 
image. 

[0003] When the image printed by the flatbed proof machine has the desired color, a final lithographic plate is created 
*5 from the output film and printing is performed by the printing machine used for final printing with the use of the final 
lithographic plate. 

[0004] With the use of this printing flow, since it takes a long time from editing to color-matching check, quick printing 
is difficult. Therefore, for example, a printing flow shown in Fig. 14 is considered 

[0005] In the processing shown in Fig. 14, the original is read by a scanner, a digital camera, or others and input to 
20 an editing apparatus such as a personal computer. After the original is edited by the editing apparatus, image data 
thereof is printed on a sheet as digital proofs by a simple digital printer. Not only the layout of characters and a picture 
is checked but also color-matching check is performed with the use of the digital proofs. Until the desired layout and 
the desired color are obtained, the processing of editing and outputting digital proofs is repeated. 
[0006] When the desired layout and the desired color are obtained, the image is output on a film, a lithographic plate 
2S js created based on the film, and printing is performed by a printing machine with the use of the lithographic plate. 
[0007] With this printing flow, quicker printing can be performed. In addition, a flatbed proof machine, which is con- 
ventionally required for color-matching check, becomes unnecessary. 

[0008] To implement the above printing processing, however, it is necessary to match the color on the digital proofs 
to the color of the image to be printed by the printing machine. To this end, the principle of a color management system 
30 (CMS) can be used. 

[0009] Fig. 1 5 shows the principle of this conventional CMS. As shown in the figure, each device has a device profile. 
With this device profile, data dependent on the characteristics of the device, device dependent color (DDC) data or 
device dependent data (DDD) (hereinafter collectively called DDC data), is converted to data independent from the 
device, device independent color (DIC) data or device independent data (DID) (hereinafter collectively called DIC data), 
as or vice versa. 

[0010] When an image on the original is read by a scanner, the image data is obtained as DDC data dependent on 
the scanner. This DDC data is edited by an editing apparatus to obtain image data which is indicated by an input image 
color signal D11 in Fig. 16. 

[0011] This input image color signal D11 is converted to a color signal D12 independent from a printing machine by 
40 the use of the device profile corresponding to the characteristics of the printing machine. 

[001 2] This color signal D1 2, which is independent from the printing machine, is converted, for example, to an output 
image color signal D1 3 which is DDC data dependent on a digital printer by the use of the device profile of the digital 
printer and printed on a print sheet by the printer 

[0013] As described above, the color of the image read by the scanner, edited, and to be printed on a print sheet by 
& the printing machine and the color of the image (digital proofs) printed on another print sheet by the printer come to 
have the corresponding (matched) measured color value. Therefore, color-matching check can be achieved by the 
color of the digital proofs, which is used as the color of the image to be printed by the printing machine. 
[001 4] If the color of a print sheet used for printing by the printing machine or the color of an observation light source 
used therefor differs from the color of another print sheet used for printing by the printer or the color of an observation 
so light source used therefor, the appearances of both images vary. Therefore, it is difficult to achieve correct color-match- 
ing check of a printed image by the digital proofs. 

[0015] Accordingly, it is an aim of at least a preferred embodiment of the present invention to provide an image 
processing apparatus and method which allows a simple and quick color-matching check, as well as a transfer medium 
for transferring a computer program for this purpose. 
ss [0016] In one aspect of the present invention there is provided an image processing apparatus for matching the 
appearance of an image on a first hard copy to be output from a first image output apparatus to the appearance of an 
image on a second hard copy to be output from a second image output apparatus, including: first obtaining means for 
obtaining the color of the paper of the first hard copy and luminous-environment data; second obtaining means for 
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obtaining the color of the paper of the second hard copy and luminous-environment data; first conversion means for 
converting the DDC data of the image to be output on the second hard copy into DIC data; compensation means for 
compensating the DIC data according to the luminous-environment data obtained by the first obtaining means and the 
luminous-environment data obtained by the second obtaining means; and second conversion means for converting 

s the DIC data compensated by the compensation means to DDC data. 

[0017] In another aspect of the present invention there is provided an image processing method for matching the 
appearance of an image on a first hard copy to be output from a first image output apparatus to the appearance of an 
image on a second hard copy to be output from a second image output apparatus, including: a first obtaining step for 
obtaining the color of the paper of the first hard copy and luminous-environment data; a second obtaining step for 

10 obtaining the color of the paper of the second hard copy and luminous-environment data; a first conversion step for 
converting the DDC data of the image to be output on the second hard copy into DIC data; a compensation step for 
compensating the DIC data according to the luminous-environment data obtained in the first obtaining step and the 
luminous-environment data obtained in the second obtaining step; and a second conversion step for converting the 
DIC data compensated in the compensation step to DDC data. 

is [0018] In yet another aspect of the present invention there is provided a transfer medium for transferring a computer 
program used for an image processing apparatus which matches the appearance of an image on a first hard copy to 
be output from a first image output apparatus to the appearance of an image on a second hard copy to be output from 
a second image output apparatus, the computer program including: a first obtaining step for obtaining the color of the 
paper of the first hard copy and luminous-environment data; a second obtaining step for obtaining the color of the 

^0 paper of the second hard copy and luminous-environment data; a first conversion step for converting the DDC data of 
the image to be output on the second hard copy into DIC data; a compensation step for compensating the DIC data 
according to the luminous-environment data obtained in the first obtaining step and the luminous-environment data 
obtained in the second obtaining step; and a second conversion step for converting the DIC data compensated in the 
compensation step to DDC data. 

25 [001 9] According to the present technique, based on the luminous-environment data for the first hard copy and that 
for the. second hard copy, the DIC data output on the second hard copy is compensated. The compensated DIC data 
is converted to DDC data. 

[0020] As described above, since compensation is performed with the paper color and the luminous environments 
being taken into account, the appearances of two hard copies can be matched. Therefore, when the present technique 

30 is applied to printing, a quick color-matching check is allowed and printing can be finished within a short period. 

[0021] The preferred techniques match the appearance of an image on a hard copy to be output from a first image 
output apparatus to the appearance of an image on a hard copy to be output from a second image output apparatus 
to allow the appearance of the image obtained from the second image output apparatus to be adjusted without actually 
outputting the image from the second image output apparatus. 

35 [0022] The invention will now be described by way of example with reference to the accompanying drawings, through- 
out which like parts are referred to by like references, and in which: 

Fig. 1 is a block diagram of a configuration example of an image processing apparatus to which the present in- 
vention may be applied; 

to Fig. 2 is a view used for describing an operation of the configuration example shown in Fig. 1 ; 

Fig. 3 is a flowchart describing a procedure for generating a look-up table; 

Fig. 4 is a block diagram of another configuration example of an image processing apparatus to which the present 
invention may be applied; 

Fig. 5 is a view used for describing an operation of the configuration example shown in Fig. 4; 
45 Fig. 6 is a block diagram of yet another configuration example of an image processing apparatus to which the 

present invention may be applied; 

Fig. 7 is a view used for describing an operation of the configuration example shown in Fig. 6; 
Fig. 8 is a block diagram of still another configuration example of an image processing apparatus to which the 
present invention may be applied; 
50 Fig. 9 is a view used for describing an operation of the configuration example shown in Fig. 8; 

Fig. 10 is a block diagram of a further configuration example of an image processing apparatus to which the present 
invention may be applied; 

Fig. 11 is a view used for describing an operation of the configuration example shown in Fig. 10; 
Fig. 1 2 is a block diagram of a specific configuration example of an image processing apparatus shown in Fig. 1 ; 
& Fig. 1 3 is a view used for describing a printing flow; 

Fig. 14 is a view used for describing another printing flow; 

Fig. 1 5 is a view used for describing a color management system (CMS); and 

Fig. 16 is a view used for describing the printing flow shown in Fig. 14. 



3 



EP 0 915 615 A2 



[0023] An image processing apparatus according to an embodiment of the present invention, which matches the 
appearance of an image on a first hard copy (for example, a print sheet Pout shown in Fig. 1 ) to be output from a first 
image output apparatus (for example, a printer 30 shown in Fig. 1) to the appearance of an image on a second hard 
copy (for example, a print sheet Pin shown in Fig. 1 ) to be output from a second image output apparatus (for example, 

s a printing machine 1 3 shown in Fig. 1 ), includes: first obtaining means (for example, sensors S3 and S4 shown in Fig. 
1) for obtaining the color of the paper of the first hard copy and luminous-environment data; second obtaining means 
(for example, sensors S1 and S2 shown in Fig. 1) for obtaining the color of the paper of the second hard copy and 
luminous-environment data; first conversion means (for example, a converter 11 shown in Fig. 1) for converting the 
DDC data of the image to be output on the second hard copy into DIC data; compensation means (luminous-environ- 

10 ment conversion circuits 1 2 and 1 5) for compensating the DIC data according to the luminous-environment data ob- 
tained by the first obtaining means and the luminous-environment data obtained by the second obtaining means; and 
second conversion means (for example, a converter 16 shown in Fig. 1) for converting the DIC data compensated by 
the compensation means to DDC data. 

[0024] Fig. 1 shows a configuration example of an image processing apparatus to which the present invention is 
'5 applied. In this image processing apparatus, a printing machine 13 serves as an input device and a printer 30 serves 
as an output device. Specifically, a scanner 20 reads an image of the original to be printed by the printing machine 13 
and an image processing apparatus 1 performs image processing. The image data to which the image processing has 
been applied is output by the printer 30 on a print sheet P out . When the color of the image printed on the print sheet 
P out is compensated and the desired color is obtained, the image data edited by the image processing apparatus 1 is 
20 output by the printing machine 1 3 on a print sheet P in . Of course, the image data is first output on a film, a lithographic 
plate is then created from this film, and printing is performed with the use of this lithographic plate. In Fig. 1, for the 
convenience of description, the output of the image processing apparatus 1 is directly supplied to the printing machine 
13, 

[0025] The scanner 20 reads an image on the original to be printed by the printing machine 13. The image color 
2S signal is an RGB (red, green, and blue) signal dependent on the device (scanner) or a CMYK (cyan, magenta, yellow, 
and black, sometimes K is missing) signal dependent on the device. For example, CMY data is sent to the image 
processing apparatus 1. 

[0026] The image processing apparatus 1 configured, for example, by a personal computer, is formed of an editing 
section 1 0, a converter 1 1 , luminous-environment conversion circuits 1 2 and 1 5, and a converter 1 6. The editing section 
30 10 edits the CMY data input from the scanner 20, according to the input of the user (editor). The converter 11 stores 
a profile P, for the printing machine 13 generated in advance. The converter 11 converts the CMY data serving as 
DDC data sent from the editing section 10 into XYZ data serving as DIC data by referencing the profile P^ and sends 
it to the luminous-environment conversion circuit 1 2. 

[0027] In addition to the XYZ data sent from the converter 11 , the outputs of a sensor and a sensor S 2 are also 

35 sent to the luminous-environment conversion circuit 1 2. The sensor S 1 is configured, for example, by a radiation color 
luminance meter. The sensor S t measures the chromaticity of surrounding light L (for example, light of a fluorescent 
lamp) in the environment where the printing machine 1 3 is installed, and sends it as a luminous-environment parameter 
to the luminous-environment conversion circuit 12. The sensor S 2 is formed, for example, of a contact-type sensor. 
The sensor S 2 measures the chromaticity of a white point on the print sheet P in of the printing machine 1 3 and outputs 

40 the measured chromaticity to the luminous-environment conversion circuit 12. 

[0028] The luminous-environment conversion circuit 12 applies compensation processing corresponding to the ap- 
pearance of color in the luminous environment for the print sheet P in to the XYZ data sent from the converter 11, 
according to the luminous-environment parameters sent from the sensors S., and S 2 , and outputs as data (X n fn) Y n jn , 
Z n jn ) (details thereof will be described later) to the luminous-environment conversion circuit 15. 

45 [0029] The luminous-environment conversion circuit 15 receives data from the luminous-environment conversion 
circuit 12, and the output signals of sensors S 3 and S 4 . The sensor S 3 measures the chromaticity of a white point on 
the print sheet P out of the printer 30 and outputs the measured chromaticity to the luminous-environment conversion 
circuit 15. The sensor S 4 measures, for example, the chromaticity of surrounding light (for example, light of a fluo- 
rescent lamp) in the environment where the printer 30 is installed, and sends it as a luminous-environment parameter 

50 to the luminous-environment conversion circuit 1 5. 

[0030] The luminous-environment conversion circuit 15 handles the data sent from the luminous-environment con- 
version circuit 12 according to the luminous-environment parameters sent from the sensors S3 and S 4 such that the 
appearance of color in the luminous environment of the printer 30 matches the appearance of color in the luminous 
environment of the printing machine 13. The resultant data is sent to the converter 16. 

55 [0031] The converter 1 6 stores a profile P 2 created in advance for the printer 30. The XYZ data sent from the luminous- 
environment conversion circuit 1 5 is converted, for example, to CMY data serving as DDC data for the printer 30 with 
the profile P 2 being referenced and sent to the printer 30. 

[0032] With these functions, the printer 30 prints on the print sheet P^ an image which has substantially the same 
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color appearance as the image printed on the print sheet Pj„. Color-matching check can thus be achieved. 
[0033] An operation thereof will be described next. The scanner 20 reads an image on the original (not shown) and 
outputs an image color signal as DDC data. The editing section 1 0 in the image processing apparatus 1 edits the output 
of the scanner 20 and generates an input image color signal D1 shown in Fig. 2. This input image color signal D1, 
s which is expressed as (C jn , M in , Y in ), is sent to the converter 1 1 and converted to a color signal D2 which is independent 
from the device according to the profile P A of the printing machine 1 3. In other words, the converter 11 performs cal- 
culation according to the following expression to output (Xj n , Y^, Z jn ). 
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[0034] In the present specification, a look-up table (LUT) used for converting a color signal dependent on a device 
to a color signal independent from the device is called a forward-direction table. Conversely, an LUT used for converting 

20 a color signal independent from adevice to a color signal dependent on the device is called a backward<Jirection table. 
[0035] The data (X^, Y jn , Zj n ), which is the color signal D2 independent from the device and generated by the converter 
11, is input to the luminous-environment conversion circuit 12. Adaptive compensation processing is applied to the 
data and the data is converted to a color signal D3 with adaptation being considered. In other words, the luminous- 
environment conversion circuit 12 applies an adaptation rate R^, indicating the degree at which the sense of human 

25 sight adapts to paper color, to three stimulus values (X iM _ ini Y, 1L | n , Z m _ in ) of the surrounding light input from the sensor 
and three stimulus values (X^^, Yp^jn, Z paperJn ) of the paper color of the print.sheet P ift input from the sensor 
S 2 to calculate a white point which the sense of human sight actually adapts to, by the following expressions. 
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35 

[0036] Namely, in the present embodiment, it is assumed that the sense of human sight partially adapts to both the 
paper color and the color temperature of the surrounding light source, and the white point to which the sense of human 
sight actually adapts is located at the middle of the paper color and the color temperature of the surrounding light source. 
[0037] In the expression (2), an adaptation rate R adp of 1 .0 indicates that the sense of human sight 100% adapts to 
40 paper color, and an adaptation rate R adp of 0.0 indicates that the sense of human sight 100% adapts to an observation 
light source. 

[0038] An adaptation rate R adp of 0.5 indicates that the sense of human sighf adapts to just the middle of the paper 
color and the observation light source. Image processing in which both the paper color and the observation light source 
are taken into account is applied to achieve best color compensation. It is found from an experiment that the best 
45 adaptation rate Radp ranges from 0.25 to 0.75. 

[0039] The luminous-environment conversion circuit 1 2 outputs the data (X^, Y in , ZJ input from the converter 1 1 as 
well as the color-signal data (X^,, Y nJn , Z nJn ) in which adaptation has been considered, to the luminous-environment 
conversion circuit 1 5. 

[0040] The tuminous-environment conversbn circuit 1 5 applies adaptation compensation processing for the printer 
50 30 to the input color signal D3, in which adaptation has been considered, to generate a color signal D4 independent 
from the device. 

[0041] In other words, the luminous-environment conversion circuit 1 5 applies an adaptation rate R adp to three stim- 
ulus values (X paper _ out , Y paper _ outl Z papef _ out ) of the paper color of the print sheet P out output from the sensor S 3 and 
three stimulus values (Xj„_ out , Yj„_ ou|) Z n ,_ out ) of the surrounding light source 1% output from the sensor S 4 to perform 
55 calculation according to the following expressions. 
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[0042] In addition, the luminous-environment conversion circuit 1 5 calculates by the following expressions data (Xo Ut . 
Y out» Zout)* w* 1 ' 0 " is a c 0101 * si 9 nal independent from the device, from the data (Xj n , Yj n , ZJ and the data (X^, Y n , n , 
Z n _ jn ) input from the luminous-environment conversion circuit 12 and the data out , Y n _ out , Z n _ out ) calculated ac- 
cording to the expression (3). 



15 
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[0043] The converter 16 applies the profile P 2 of the printer 30 to the color signal D4, independent from the device 
and input from the luminous-environment conversion circuit 15, to generate an output image color signal D5 dependent 
on the printer 30. The signal is sent to the printer 30 and printed on the print sheet P out . 

[0044] in other words, the converter 16 applies the profile P 2 of the printer 30 to the data (X^, Y out , Zo Ut ), which is 
the color signal D4, independent from the device and input from the luminous-environment conversion circuit 15, to 
generate data (C out , M out , Y out ) dependent on the printer 30. Namely, the converter 16 performs calculation according 
to the following expression. 
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[0045] Since input and output are performed as described above with both the luminous environment and the paper 
color being taken into consideration, the appearances of the color images on the print sheet P in and the print sheet 
P out are matched. 

[0046] Fig. 3 shows processing for generating a forward-direction table for the converter 1 1 and a backward-direction 
table for the converter 16. In a first step S1, color patches are measured. Namely, the original having N 3 color patches 
each of which has, for example, one of N levels of C, M, or Y color is prepared as the original printed by the printing 
machine 13 and the chromatic values (XYZ values) thereof are measured by a spectrometer, A device signal (C, M, 
Y) input to the printing machine 1 3 when each color-patch image is printed by the printing machine 1 3 is also measured. 
[0047] In a step S2, it is determined whether a sufficient number of data items have been measured. When it is 
determined that a sufficient number of data items have been measured, processing such as internal interpolation is 
not applied in a step S3 and the procedure proceeds to a step S5. A forward-direction table is generated from the 
relationship between both. 

[0048] On the other hand, if it is determined in the step S2 that the number of the data items is insufficient, a pseudo 
measured value is obtained by internal interpolation. In this case, high-order interpolation is usually used as the internal 
interpolation, which has higher interpolation precision than linear interpolation. When the internal interpolation is fin- 
ished in a step S4, the procedure proceeds to the step S5 and a forward-directbn table is generated. 
[0049] When the forward-direction table is generated, the procedure proceeds to a step S6, and a reverse mapping 
table is generated from the forward-direction table. In other words, the value of each point in the forward-direction 
table, which is expressed in a CMY coordinate system, is placed in an XYZ coordinate system. In a step S7, it is 
determined whether each placed point is located within a color area. When it is within the color area, it is determined 
in a step S8 that the sampled values are used as is, and a backward-direction table is created in a step S10. If it is 
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determined in the step S7 that each placed point is located out of the color area, the procedure proceeds to a step S9 
and color-area compression processing is applied. Then, the procedure proceeds to the step S10 and a backward- 
direction table is generated Namely, a backward-direction table (table expressed by XYZ coordinates) in a color area 
in which the printer can expresses the color is generated. 

[0050] Fig. 4 shows another embodiment of the present invention. In this embodiment, a profile for the printing 
machine 13 used in the converter 11 in the image processing apparatus 1 is generated with adaptation compensation 
in the printing machine 13 being taken into account. Therefore, the luminous-environment conversion circuit 12 in the 
embodiment shown in Fig. 1 is omitted. In the same way, a profile P 2 i for the printer 30 used in the converter 16 is 
also generated with adaptation compensation in the printer 30 being taken into consideration. Therefore, the luminous- 
environment conversion circuit 15 in the embodiment shown in Fig. 1 is omitted. The other configurations are the same 
as those in the embodiment shown in Fig. 1 . 

[0051] In the embodiment shown in Fig. 4, an input image color signal D1 is converted to a color signal D3 in which 
adaptation is considered, according to the profile in the converter 11 as shown in Fig. 5. 
[0052] In the embodiment shown in Fig. 1, the LUT is generated from the relationship between the device color 
signals and the measured values. In the embodiment shown in Fig. 4, a measured value is converted to a perception 
amount in which an appearance is considered and an LUT is generated from the relationship between the perception 
amount and a device color signal. 

[0053] In other words, a perception amount (X^, Y rel , Z rel ) in the sense of human sight is expressed by the following 
expressions when a color having a measured value of (X^^, Y mesure , Z mefiUfB ) is observed in adaptation to a white 
point ()(„, Y n , Z n ). 
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(6) 



[0054] The white point (X n , Y n , Z n ) is defined as follows, where paper color is indicated by (Xp^, Y paper , Zpa per ) 
30 and an observation light source is expressed by (X n |, Y jD , Z itl ). 
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[0055] Therefore, an LUT needs to be generated from the perception amount in the expressions (6) and a device 
40 color signal. 

[0056] An LUT serving as the profile P 21 in the converter 16 needs to be made as the backward-direction table of 
the LUT serving as the profile P n in the converter 11. 

[0057] Therefore, in the embodiment shown in Fig. 4, the converter 11 performs the calculation indicated by the 
following expression to output data (X^, Y re |, Z re) ). 
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[0058] The converter 16 performs the calculation indicated by the following expression. 
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[0059] As described above, the device profile is generated with the appearance being taken into account. Just by 
conversion with the device profile, the appearance can be matched. 

[0060] In Fig. 5, the color signal D3, in which adaptation has been considered, is converted to an output image color 
signal D5, which depends on the printer 30, with the use of the profile P 21 in the converter 16. 
[0061] Fig. 6 shows still another embodiment. In this embodiment, data output from the converter 11 is converted to 
a color signal LMS at a human pyramidal level by a conversion circuit 51, and input to the luminous-environment 
conversion circuit 12. In the same way, a color signal LMS at the human pyramidal level output from the luminous- 
environment conversion circuit 1 5 is converted to a color signal XYZ which is not dependent on a device by a conversion 
circuit 52, and input to the converter 16, The other configurations are the same as those in the case shown in Fig. 1 . 
[0062] In other words, in this embodiment, an input image color signal D1 is converted to a color signal D2 inde- 
pendent from the device by the use of the profile 9 A in the converter 11 as shown in Fig. 7. Namely, calculation is 
performed according to the fol towing expression. 
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[0063] The color signal D2, which is independent from the device, is converted to a color signal D31 at the pyramidal 
level by the conversion circuit 51 . 

[0064] In other words, the conversion circuit 51 performs the Hunt-Pointer-Estevez conversion, shown below, to 
35 generate the color signal (Lj n , M jn , S in ) at the human pyramidal level. 
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[0065] The luminous-environment conversion circuit 1 2 performs adaptation compensation at the input side to gen- 
erate a color signal D32 at the pyramidal level, in which adaptation is considered. 

[0066] In other words, the luminous-environment conversion circuit 12 performs the calculation indicated by the 
following expressions with the use of the data (X m in , Y ilLin , Zj| Un ) output from the sensor S 1 , the data (Xpa^, in in , 
50 z paperjn) output from the sensor and the adaptation rate~R adp - 
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S n_in ~ R adp' S paper_in + ( 1 
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(12) 
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[0067] (L paporJn , M paper _ in , S paperJn ) and (L nUnt Mj, Lin , S ilLin ) are obtained by applying the Hunt-Pinter-Estevez con- 
version, shown in the expression (11 ), to the data (X^^ in , Y^^, ini jft ) output from the sensor S 2 and the data 
( x iiLin> Y iiijn> z nun) out P u t from the sensor Sj, respectively. 

[0068] A white point (L^jn, M nJn , S^) obtained from the expression (1 2) is substituted into the Von Kries adaptation 
5 rule to perform the calculation indicated by the following expressions. 
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[0069] With this operation, data (L re(1 M^, S rel ) which is not dependent on the luminous environment is obtained. 
[0070] The luminous-environment conversion circuit 15 applies adaptation compensation to this data to convert to 
a color signal D33 at the pyramidal level. 

[0071] In other words, the luminous-environment conversion circuit 1 5 applies the following expressions to the data 
(L re |, M^,, S re |). which is not dependent on the input luminous environment, to generate data (L^,, M out , S out ), 
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[0072] Data (L n _ out , M n _ out , S n out ) in the expression (14) is obtained from expressions (15). (Lp aper _ out , M paper _ out , 
s paper_out) in tne expressions (1 5) is obtained by applying the Hunt-Pinter-Estevez conversion, shown in the expression 
(11), to the data (X paper out , Y paper _ oul , Z^,^ output from the sensor S 3 . In the same way, (L ilLout , M jll outl S iILout ) 
is obtained by applying the Hunt-Pinter-Estevez conversion to the data (Xj )Logt , Y n * Lou|l Zj„_ out ) output from the sensor S 4 . 
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[0073] The color signal D33 at the pyramidal level shown in Fig. 7 is converted to a color signal D4 which is not 
dependent on the device by the conversion circuit 52. 

[0074] In other words, in this case, the conversion circuit 52 performs the conversion reverse to that in the case 
shown in the expression (11) to generate data (X^, Y out , Z out ) from the data (L^, M out , S out ) input from the luminous- 
environment conversion circuit 15. 
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[0075] Next, the color signal D4 shown in Fig. 7, which is not dependent on^the device, is converted to an output 
image color signal D5 with the use of the profile P 2 in the converter 16. 

[0076] In other words, the converter 16 performs the calculation indicated by the following expression. 
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[0077] Fig. 8 shows yet another embodiment. In this embodiment, the luminous-environment conversion circuit 12 
and the luminous-environment conversion circuit 15 are omitted from the embodiment shown in Fig. 6. The other 
configurations are the same as those in the case shown in Fig. 6. 

[0078] In other words, in the embodiment shown in Fig. 8, an input image color signal D1 is converted to a color 
signal D301 in which adaptation is considered, by the use of the profile P 12 in the converter 11 . Namely, the converter 
11 performs the calculation indicated by the following expression. 
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[0079] The conversion circuit 51 applies the Hunt-Pointer-Estevez conversion to the data (>(„,,, Y rel , Z ro) ) input from 
the converter 11 and serving as the color signal D301 , in which adaptation is considered, to convert to data (L^, M re |, 
s rei) serving as a color signal D302 at the pyramidal level in which adaptation is considered, as shown in Fig. 9. 
[0080] The conversion circuit 52 applies the conversion reverse to that in the conversion circuit 51 to the input data 
30 (L rel , M re ,, S re |) to convert to data (X^,, Y rel , Z rel ). In other words, the color signal D302 at the pyramidal level shown in 
Fig. 9, in which adaptation is considered, is converted to a color signal D303 in which adaptation is considered. 
[0081] The converter 16 then converts the color signal D303, in which adaptation is considered, to an output image 
color signal D5. 

[0082] Namely, the converter 16 generates data (C out , M out , Y oul ) from the data (X^, Y re) , 2 rel ) input from the con- 
35 version circuit 52, with the profile P^ being referenced. In other words, the converter 16 performs the calculation 
indicated by the following expression. 
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[0083] An embodiment shown in Fig. 1 0 is obtained by further simplifying the configuration of theembodiment shown 
in Fig. 8. In the embodiment shown in Fig. 10, the conversion circuit 51 and the conversion circuit 52 shown in Fig. 8 
are omitted and the functions thereof are substantially included in a profile P 13 in the converter 11 and a profile P 23 in 
so the converter 16. The other configurations are the same as those shown in Fig. 8. 

[0084] In other words, in the present embodiment, as shown in Fig. 11, an input image color signal D1 output from 
the editing section 10 is converted by the use of the profile P 13 to a color signal D302 at the pyramidal level in which 
adaptation is considered. Namely, the converter 11 performs calculation according to the following expression. 
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[0085] On the other hand, the converter 16 converts the received color signaT D302 at the pyramidal level, in which 
adaptation is considered, to an output image color signal D5 with the use of the profile P23. Namely, the converter 16 
performs calculation according to the following expression. 
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[0086] The above-described image processing apparatus 1 is formed of a computer, such as a personal computer. 
Fig. 12 shows a configuration example of a computer 2000 which constitutes such an image processing apparatus 1 . 
This computer 2000 is obtained by adding a sensor, a communication unit, etc., as required, to a personal computer 
currently available. 

[0087] A CPU 201 has functions for controlling the whole apparatus and for calculation, and is formed, for example, 
of a Pentium (trademark) of Intel Corporation. A cache 202 is a high-speed storage section for storing information 
stored in a memory and frequently accessed by the CPU 201. With direct information transfer between the CPU 201 
and the cache 202, the system can perform high-speed processing. 

[0088] A system controller 203 is a circuit section for adjusting timing among the CPU 201 , the cache 202, a memory 
204, a computer bus 209, and a PCI bus 210, and is formed, for example, of TRITON (430FX) (trademark) of Intel 
Corporation. 

[0089] The memory 204 is a storage section for information write and read according an instruction of the CPU 201 
or the system controller 203, and is formed, for example, of a DRAM (dynamic random access memory). The memory 
204 is connected to the CPU 201 and various resources on the computer bus 209 through the system controller 203 
and stores information. Of course, the memory 204 can store the above-described image data. 
[0090] The computer bus 209 is information transfer means directly connected to the CPU 201 and can transfer 
information with the cache 202 and the system controller 203 at a high speed. The PCI bus 210 is information transfer 
means separated from the computer bus 209, and is connected to the system controller 203. The CPU 201 can access 
through the system controller 203 various resources connected to the PCI bus 210. 

[0091] An external storage control section 211 is connected to the PCI bus 210 and a hard disk 212 and a CD-ROM 
drive 21 3, and controls information write and read operations to and from a certain area in a disk mounted on the hard 
disk 212 or the CD-ROM drive 213 according to an information access request sent through the PCI bus 210. For 
example, these connections are performed by SCSI or IEEE 1 394. An external storage unit is not limited to the hard 
disk 212 or the CD-ROM 213, and can be a unit which uses a writable and removable recording medium, such as a 
floppy disk and a magneto-optical disk. In that case, the data required for the present invention, such as image data 
for which the above-described conversion is performed, a luminous-environment parameter, and appearance index 
data, is stored in the recording medium and transferred, instead of being transmitted and received. 
[0092] A keyboard and mouse control section 21 4 connects a keyboard 21 5 and a mouse 216 serving as a pointing 
device to the PCI bus 210, and transfers to the CPU according to a certain sequence a character, a numeral, and a 
symbol which the user inputs or the movement of the mouse and the operation of a mouse button which the user 
performs. With this function, the CPU 201 receives the user input information while the CPU 201 relatively moves a 
pointer displayed together with an image displayed on a CRT (cathode ray tube) monitor 226 through a video controller 
225. Of course, an input on the above-described setting screen is also possible in the same way. 
[0093] A scanner and printer control section 217 is connected to the PCI bus 210 and a scanner 218 and a printer 
219, and controls image-information write and read operations according to an information access request sent through 
the PCI bus 21 0. These connections are usually performed by SCSI or IEEE 1 394. Information to be transferred includes 
information read or input optically, information to be printed or output, and in addition, device characteristic information 
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stored in the scanner 218 or the printer 21 9 and used for the above-described DIC and DDC conversion. 
[0094] A communication control section 220 is connected to a telephone line 222 through a modem 221 or connected 
to a network 224, such as IEEE 802.3 (Ethernet), FDDI, ATM, or IEEE 1394, through a network communication unit 
223, such as a transceiver or a hub, and controls information transmission and receiving according to an information 
access request through the PCI bus 21 0 or an information access request from a communication destination. Of course, 
the data required for the present invention, such as image data for which the above-described conversion is performed, 
a luminous-environment parameter, and appearance index data, can be transmitted and received. 
[0095] The video controller 225 is connected to the PCI bus 210, and draws information such as an image, a figure, 
or a character on a video memory (not shown) of the video controller 225 and displays the contents on the CRT monitor 
226. Of course, the above-described image data can be stored in the video memory of the video controller 225. Device 
characteristic information, such as the VESA DDC (display data channel) specification, stored in the CRT monitor 226 
can also be transferred between the video controller 225 and the CRT monitor 226. 

[0096] The CRT 226 is connected to the above video controller 225, and displays an image which the video controller 
draws, according to an instruction of the CPU 201 . Of course, instead of the CRT monitor, other display devices such 
as a PDP (plasma display panel) and a liquid-crystal display can be used. In the present invention, the CRT monitor 
226 also displays a soft copy image in cooperation with the video controller 225, and achieves an input device function 
for an image which a user observes at the transmission end and an output device function for an image which another 
user observes at the receiving end. 

[0097] A sensor control section 227 is connected to the PCI bus 21 0 and various sensors 228, and detects a physical 
amount such as a voltage, a temperature, or brightness, according to an instruction of the CPU 201 . In the embodiments 
of the present invention, the sensor control section plays a role as a sensor for measuring a luminous-environment 
parameter, and detects the chromaticity of surrounding light, the chromatictty of the CRT monitor 226, and the absolute 
luminance. 

[0098] In the above descriptions, an observation light source is taken into account as a luminous environment. Other 
luminous environments can be taken into consideration. 

[0099] As a transfer medium for transferring a computer program that performs the above-described processing to 
the user, a recording medium such as a magnetic disk, a CD-ROM, and a solid-state memory, and a communication 
medium such as a network and satellite can be used. 



Claims 

1. An image processing apparatus for matching the appearance of an image on a first hard copy to be output from 
a first image output apparatus to the appearance of an image on a second hard copy to be output from a second 
image output apparatus, comprising: 

first obtaining means for obtaining the color of the paper of the first hard copy and luminous-environment data; 
second obtaining means for obtaining the color of the paper of the second hard copy and luminous-environment 
data; 

first conversion means for converting the DDC data of the image to be output on the second hard copy into 
DIC data; 

compensation means for compensating the DIC data according to the luminous-environment data obtained 
by said first obtaining means and the luminous-environment data obtained by said second obtaining means; 
and 

second conversion means for converting the DIC data compensated by said compensation means to DDC 
data. 

2. An image processing method for matching the appearance of an image on a first hard copy to be output from a 
first image output apparatus to the appearance of an image on a second hard copy to be output from a second 
image output apparatus, comprising: 

a first obtaining step for obtaining the color of the paper of the first hard copy and luminous-environment data; 
a second obtaining step for obtaining the color of the paper of the second hard copy and luminous-environment 
data; 

a first conversion step for converting the DDC data of the image to be output on the second hard copy into 
DIC data; 

a compensation step for compensating the DIC data according to the luminous-environment data obtained in 
said first obtaining step and the luminous-environment data obtained in said second obtaining step; and 
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a second conversion step for converting the DIC data compensated in said compensation step to DDC data. 

A transfer medium for transferring a computer program used for an image processing apparatus which matches 
the appearance of an image on a first hard copy to be output from a first image output apparatus to the appearance 
of an image on a second hard copy to be output from a second image output apparatus, said computer program 
comprising: 

a first obtaining step for obtaining the color of the paper of the first hard copy and luminous-environment data; 
a second obtaining step for obtaining the color of the paper of the second hard copy and luminous-environment 
data; 

a first conversion step for converting the DDC data of the image to be output on the second hard copy into 
DIC data; 

a compensation step for compensating the DIC data according to the luminous-environment data obtained in 
said first obtaining step and the luminous-environment data obtained in said second obtaining step; and 
a second conversion step for converting the DIC data compensated inlaid compensation step to DDC data. 
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FIG. 2 
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FIG. 3 
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FIG. 5 
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FIG. 7 
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FIG. 9 



D1 



D301 



INPUT IMAGE COLOR SIGNAL 




> 


< — 

r 


COLOR SPACE 
■ SECTION FOR 
(DEVICE PROF 


CONVERSION 
INPUT 

ILE FOR INPUT) 


COLOR SIGNAL WITH 
ADAPTATION BEING 
CONSIDERED 


t 








ADAPTATION COMPENSATION 
AT INPUT SIDE 


r > 


t 





D302 



COLOR SIGNAL AT PYRAMIDAL 
LEVEL WITH ADAPTATION 
BEING CONSIDERED 



ADAPTATION COMPENSATION 
AT OUTPUT SIDE 



> 

COLOR SIG 
ADAPTATIOI 
CONSIDERE 


f 

NAL WITH 
N BEING 

ID 




t 




< 

> 


COLOR SPACE 
- SECTION FOR 
PROFILE FOR 


CONVERSION 
OUTPUT (DEVICE 
OUTPUT) 


OUTPUT IMAGE COLOR SIGNAL 





22 



EP 0 915 615 A2 




EP 0 915 615 A2 



FIG. 11 
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FIG. 12 
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(57) An image on the original to be printed on a print 
sheet (P in ) by a printing machine (13) is scanned by a 
scanner (20), and the data is edited by an editing section 
(10). The edited data is converted from the data depend- 
ent on the device (printing machine) to data not depend- 
ent on the device with the use of a device profile (P^ 
included in a converter (11). A luminous-environment 
conversion circuit (12) compensates the data sent from 
the converter (11) according to the data corresponding 



to surrounding light, output from a sensor (Sj ), and data 
related to the paper color of the print sheet (P jn ), output 
from a sensor (S 2 ). Another luminous-environment con- 
version circuit (15) compensates input data according 
to the paper color of a print sheet (P oul ) in a printer (30) 
or surrounding-light data, output from sensors (S 3 and 
S 4 ). Another converter (1 6) converts the output of the 
luminous-environment conversion circuit (15) to data 
dependent on the printer (30) and the data is printed on 
the print sheet (P out ) by the printer (30). 
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